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Abstract 

In  the  present  paper  estimation  of  the  larger  of  two  normal  means  is  studied. 
Two  new  estimators  are  added  to  the  class  of  possible  estimators  of  the  larger 
normal  mean,  namely,  the  maximum  probability  estimator  and  the  iterated  bias 
elimination  estimators.  If  the  magnitude  of  the  difference  between  the  two 
population  means  is  not  close  to  zero  (as  evidenced  by  its  strongly  consistent 
estimator,  the  magnitude  of  the  difference  between  the  two  sample  means)  a 
suitably  chosen  maximum  probability  estimator  is  seen  to  be  best  as  regards 
both  bias  and  mean -squared  error. 

1,  Introduction 

Let  be  a  random  sample  of  size  n  from  a  normal  population  with 

2 

mean  and  variance  a  ,  i  =  1,  .  .,k  (>  2).  Let  <  ...  <u^kj  be  the 

2 

ordered  unknown  means  and  suppose  s  is  known.  The  estimation  analog  of  the  well- 
known  ranking  and  selection  problem  [see  Bechhofer,  Kiefer,  and  Sobel  (1968)] 
has  been  the  topic  of  inquiry  by  Alam  (1967),  Blumenthal  (1975,  197<>),  Blumenthal 
and  Cohen  (1968),  Pudewicz  (1971.  1972,  1973,  1976)  and  others.  Once  the 
decision  has  been  made  as  to  which  of  the  k  populations  has  the  largest  mean, 


1 


it  is  natural  to  ask,  "How  large  is  this  largest  mean?"  For  two 

examples  of  application  of  estimation  of  the  larger  normal  mean,  the  reader  is 

referred  to  Blumenthal  and  Cohen  (1968). 

In  this  paper  we  study  this  problem  and  attempt  to  enlarge  the  class  of 
estimators  of  the  larger  mean.  In  section  2  we  investigate,  mostly  numerically, 
the  behavior  of  a  class  of  estimators  called  Maximum  Probability  Estimators 
(MPE's)  introduced  by  Weiss  and  Wolfowitz  (1967).  Dudewicz  (1973)  first  gave 
the  MPE's  of  the  ranked  means.  In  section  3  a  new  class  of  estimators  called 
Iterated  Bias  Elimination  Estimators  (iBEE's)  are  introduced  and  investigated. 

A  comparison  along  the  lines  of  Blumenthal  and  Cohen  (1968)  is  made  in  section  U. 

2.  Maximum  Probability  Estimators 

Definition  (Weiss  and  Wolfowitz).  Let  0  be  a  closed  region  in  the 

m-dimensional  Euclidean  space  I?,  0  K  S’,  where  0  is  a  closed  region  such  that 

every  finite  boundary  point  of  6  is  an  inner  point  of  0.  For  each  n  let  X(n) 

denote  the  (finite)  vector  of  random  variables  of  which  the  estimator  is  to  be 

a  function.  Let  K  (x,0)  be  the  density  of  X(n)  with  respect  to  a  sigma-finite 

measure.  Let  R  be  a  fixed  bounded  set  in  and  let  k(n)  =  (k.,  (n) , . . .  ,k  (n)) 

_L  m 

be  a  sequence  of  numbers  such  that  k,,  (n)  •*  “  (n  •*  •)  for  each  i.  Let  d  = 

(d^,  ...,dffl)  and  a  -  R/k(n)  =  [(z^, ...,zm)  €  »:  d^-y^/k^fri)  =  i  =  l,...,m; 
(y1} . . . ,yrft)  €  Hi.  Then  is  en  MPS  with  respect  to _R  and  k(n)  if  Z  (x)  equals 
a  d  €  9  such  that 

f  K  (x,e)de  =  sup  f  k  (x,e)do  .  (2.1) 

+  c  o  J  n 
d-R/k(n)  *  *  6  t-R/k(n) 

Now  let  X^,..,,X^  denote  the  sample  means.  Let  in  the  above  definition 


X(n)  = 


8  =  *k  , 


and 


®  -  Cti.  =  (u-^>  •  •  •  >U^)  ®  =  ^[i]*  *  *  *y^k  ~  ^[k]^ 


K  (Xjfi)  —  y  (x.j...jX,  J  u) 

n  A[l  V  *  *  •  »  1  -*-  k 


[k] 


with  respect  to  Lebesgue  measure  on  T  where  X^-j  <  ...  <  X^-j  are  ordered 
sample  means.  (Note  that  ^(x,  e)  0  iff  x  <  ...  <  *  .)  Let 

k(n)  =  {Jr\/a, . . .  ,*/n/a) 


and 


H  =  (-T1/2,rl/2)  X(  -r  rj  2  ,T  rj  2)X  ...  X[-rJ?,rJ 


r^,...,^  being  positive  real  numbers.  Define 


<-  /  9 


r  k  or.  or  . 

d-R/k(n)  =  c-  B  :  d - -  <  ut  <  dj[  +  —  ,  i  -  1,  ...,k]  . 

a/n  " 1=1 


We  know  that 


k  k  x  ,  ^  -  u. 

%  y  (xi  i  *•  m\!m)  =  i.fn/a)  L  TT  a  ( •  — — - ' 

X[i],...>Xr„1  1  It  «,  *  C  4_1 


v[k] 


P  €  S,  i=l 
k 


a  A/n 


where  is  the  set  of  permutations  on  integers  l,...,k  and  <^(»)  denotes  the 

standard  normal  density  function.  With  dp^\  =  ,^i(Xp^  -  )/n  and 

t.  =  x.  +  a. a/Jn  we  find  from  the  definition  that  t  =  (tn ,...,t,  }  is  an  MPE  for 
i  i  i  l  k 

U  =  j, . .  muj^ j)  if  a  =  (a^,...,^)  are  chosen  so  as  to  achieve 

SUP  H  \  «*  ri  {l(d0fi)-ai  *  ‘  f(dP(i)-ai‘ri/2)} 

a  p  t  b.  1=1 


:.2i 


where  •(•)  denotes  the  distribution  function  of  a  standard  normal  variable. 
For  values  of  k  up  to  about  20  and  using  the  observed  values  of  d^'s 
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r* 

d 

8 

g 

hi 
t  ^ 

ve  can  find  a^, by  utilising  some  function  maximization  (minimization)  r 

algorithm  such  as  that  of  Helder  and  Mead  (1965). 

In  the  rest  of  this  section  we  investigate  numerically  the  MPE's  of  i 

J 

(^[l],u[2])’  that  iS’  f°r  th®  Ca8e  k  =  2*  For  the  values  of  the  diffcrence 

between  the  larger  and  the  smaller  sample  means  considered,  after  a  preliminary  , 

» 

analysis,  we  found  that  we  could  treat  r^,r^  =0.5,  1,5,  and  5*0  as  small,  j 

medium,  and  large  respectively  for  the  study.  Thus  we  have  nine  pairs  of  j 

(j’l,r2 )  to  look  at.  We  found  numerically  that  for  d  <  min  (r^Jrg)>  =  -a^  =  d/2 
maximize  j 

2  .  ,  ,  j 

s(al,a2)  =r  Zc  _  l*(d?(i)  “  ai  +  ri/2)  "  #(dP(D  ‘  ai  "  ri/£)J  i 

P  e  i>2  1=1  j 

t 

i 

=  {*(a1  +  rx/2>  -  •(a1  -  rx/2)}  {*(a2  +  rg/2)  -  *(»2  -  rg/2)|  ! 

■^•(a1  -  d  +  ri/2)  -  *(a1-d_r;i/2)j  {•(a2'*-d+r2/2)  -  *(a2+d-r?/2)}  , 

where  d  =  */n(x2-x^)/a.  This  observation  was  checked  with  r1,r?  changing  in 
steps  of  0.1  from  0.1  to  3.5.  Redefining  and  tg  as  =  x1  +  a^o/Jn  and 

t2  =  X2  *  we  can  write  as 

g(a1,a2)  =  {•(a1  +  r^/sD  -  *(a]_  -  r^/d)  {*(&,,  +  r^2)  -  *(a?  -  r?/2)} 

+  {•(a1-dtr1/2^  -  •(a1-d  -r1/2)|  {*(ag-d*rg/2&  -  *(ag-d-r ^2]  (2.3) 

and  now  =  ag  =  d/2  maximize  g(a1,a2>  for  d  <  min  (r^r^.  Table  1  gives  the 
values  of  (a1,a2)  for  the  above  nine  pairs  of  (r^Tg)  for  d  =  0.1(0. 1)3. 5.  We 
tabulate  for  only  six  (  r1,rg)  pairs  because  of  the  subscript  symmetry  in 
(2.3)  and  hence  the  other  three  columns  car  be  deduced  from  this  table  itself. 

For  these  calculations  the  Nelder-Mead  (1965)  simplex  method  was  utilized.  For 

H 


&  JS 


each  of  the  nine  (r^Tg)  P8^-1"8  80,1  «*ch  value  of  d,  it  was  verified  that 
gta^0  +  IQ'7,  ag0  +  lO-?)  <  g(a^C)>  a^°)  where  (a1°,a2°)  is  the  calculated 
value.  Thus  the  values  reported  are  correct  to  seven  decimal  places. 

Bias.  Nov  without  loss  of  generality,  ve  consider  the  MPE's  of 
only.  For  given  r-^Tg,  the  MPE  of  is  given  by 


*2  ‘  Vrl’r2>  "  Xt2]  -  ’  *2<Z"  rl<  r2> 

where  t  =  a/Jr\  and  Z  =  (X^  -  X^)/2.  Therefore,  the  bias  is 
B(t2)  =  B(tg,  ®,  «r) 

CD 

=  S(X[2])  -t  f  a2(z,  »,  -)dz 

where  B(X^)  denotes  the  bias  of  Xj?j  as  an  estimator  of  and 

f(z,  »,  t)  =  ^  -[^Cy2(z-«)/t)  +  $C/2(z**)/t)],  z  >  0 


(2.4) 


(2.5) 


is  the  density  of  Z  with®  =  (h[2]  -  ^[i])/2*  Also  from  Blumenthal  and  Cohen 
(1968)  we  have 


2  2 

B(X[2])  =  —  e-*/T  -2si*(V2  */')■ 
*/" 


(2.6) 


From  (2.4),  (2.5),  and  (2.6)  it  is  clear  that  B(t2,  t)  =  r  B(t2>  T ,  l). 

Therefore,  we  take  t  =  1  in  the  following  calculations  and  the  values  reported 
are  in  units  of  t.  Values  of  b(X^2j)  are  given  in  Blumenthal  and  Cohen  (1968); 
we  independently  verified  these  values. 

Now,  from  Dudevicz  (1973)  ve  know  that  0  <  a2  <  2Z.  Also  <^(,/?  (z-ms))  < 

+  U§(z+)).  Therefore,  if  we  approximate  r  a2(z,  rx,  r2)f(z,  m)dz  by 


£ 


a2(z,  r^,  r2)f(z,  ®)dz,  the  error  due  to  this  truncation  is 


E  =  r  a  (z,  r, ,  r  )f(z,  u>)dz 
'M  *  * 

m 

<  Ujz  z  ^(./2(z-*)  )dz. 

‘  M 

In  order  to  bound  E_  by  *,  it  suffices  to  find  an  M  =  M  (m)  such  that 
i  e 

Kf2  f  z  \{J2{  z-tu)  )dz  <  c. 

Me(«) 

M  (•) 

f  ,  , 

Prior  to  the  numerical  evaluation  of  the  integral  I.,  =  >  a0(z,  r,  ,  Tr  f  ,  z,  m 

M  v  ^  d  -  c 

a  study  of  the  function  g(z,  r^,  r 2>  »)  =  a^z,  r^,  r2)f\z,  u>  revealed  that 

this  function  has  a  sharp  peak  (possibly  a  non -differentiable  point)  in  the 

interval  [0,  M  («)],  Three  typical  functions  are  graphed  in  Figure  1.  This  fact 
e 

is  an  indication  that  one  should  evaluate  the  integral  1^  in  two  part;-,  namely, 
in  intervals  [0,a]  and  [a,b],  where  a  =  a(»)  is  the  point  such  that 
&2(z,  r1,  r2)  =  2  for  z  <  a  [note  that  a  turns  out  to  be  the  same  point  where 
a^( z,  r^,  rg)  starts  decreasing]  and  b  -  b(»)  is  such  that  &0'z,  r0)  ^  e 

for  z  >  b.  It  was  found  that  in  each  case  considered  h  <  !•'.  (®).  Since  for 


z  ^  b,  a?(z,  r?)  <  e. 


a^(z,  r.,  r  )f(z,  ®)dz  <  *. 

v  b  "  1  ^ 


Hence  we  used  Gaussian  quadrature  formula  [see  Stroud  and  Secrest  (1966)] 

a  b 

r  |* 

1  a„( z,  r  ,  r  )f(z,  o»)dz  *  1  a„(z,  r, ,  r_)f'r.  ®  dz 
-  0  12  *  a  12 

to  approximate 

OP 

p  ,  , 

a0<z,  Pij  r  ;f'z,  »;dz. 

'O'  1  ? 


,dz 
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To  control  the  error  due  to  quadrature,  for  each  (  r^,  r„)  pair  each  of 
the  integrals 

a 

I* 

1.  =  a_(z,r,  r„)f(z,  ®)dz 

x  '  0  ?  1  2 

and  b 

r 

I?  =  '  a?(z,  r1,  r2)T(z,  «)dz 
’  a 

was  evaluated  in  3,  5,  7,  cr  9  subintervals  using  6U  and  1?8  point  Gaussian 
quadrature  formulas.  The  criterion  used  to  stop  subdividing  each  subinterval 
was  that  the  two  values  of  the  integral  I.  obtained  using  om  and  1?8  points 
respectively  for  a  subdivision  of  the  subinterval  differ  by  no  more  than  e", 
i  =  1,2.  Thus  our  approximation  involves  an  error  due  to  quadrature  plus  an 
error  due  to  truncation  which  is  bounded  above  by  t  +  e*.  We  used  *  =  c*  =  1C“'. 
Thus  we  have 


•  v1? 


Mean-squared  error  (MSE).  We  have 


MSE(t, 


MSE(  tp,  'i> ,  < 


-  MSE(X^p-j )  +  E  [r2ap2{Z,  r^,  rg)  .  2r( v-t» )a?{ Z,  )  J 

CD 

»  MSE(X[?])  -  t2  J  [2 (J  -^a?(Z,  r1?  rp  ;  -  a??(7.,  rg)  .f(z,  «,  ^dz. 


Also 


_.oo  2  ,  r 

MSE(Xj-p-j)  =  t  -t  Uu  ♦  (_,/?  ®/t)  -  '  ?  uiT  ,/T)e  * 


has  been  tabulated  by  Bluiaer.thal  and  Cohen  (1968);  we  independently  verified 
these  values.  Again,  it  is  clear  that  «,  t  :  -  MSl-Jit  , 

t*  r  T 


1). 


Ml  the 


calculations  run  parallel  to  those  for  the  bias  except  that  new  bounds 
are  found  to  approximate  the  integral  in  (2.7). 

Tables  2  and  3  below  give  the  bias  and  MSE  respectively  of  fc  (r^,  rg '  • 

We  see  that  smaller  values  of  r^,  rg  give  rise  to  smaller  |bias |  and  smaller 


3.  Iterated  Bias  Elimination  Estimators 


Consider  the  case  of  k  =  2  normal  populations  with  means  u,  and  and  a 

X  t 

2  *(1)  -  *(i)., 

common  known  variance  o.  Let  X  =X[2]  ®  denote  the  bias 

*(l)  A*(l)/  \ 

of  X  as  an  estimator  of  Let  ®  («/  denote  a  consistent  estimator 

*(l)/  \  *(?)  *(l)  a*(iV  \  *(  g'l  ,  . 

of  B  v  '(«).  Define  X  =  X  K  ‘  -  B  v  ;(«)  which  has  a  bias  of  B  Vc'*<d)  as 

A*(2h  ,,  x 

an  estimator  of  Le-t  B  (u»)  denote  a  consistent  estimator  of  3  )  . 

Continuing  the  process,  let  X  ^  =  X  _  §  ^ra_1/(0l)  ,  m  =  2,3,...  .  In  this 

section  we  investigate  the  class  of  estimators  (X  '  ;  ;  m  =  1,2,...)  of 

?  2 

Let  C*(o)(«)  =  —  e®  /T  -3u  Kj2*/*),  and  C*(m)(»)  = 

J* 

2/2/  4-1  ) 

**— ■ *  -  t  e  T  m+  -2«#(.,/2  r),  m  =  1,2, ...  .  We  estimate  ^  (which  appears 

•f* 

in  B  (m)(.)  through  the  continuous  function  C  u>)  ,  m  =  1,2,...)  by  its 

strongly  consistent  estimator  Z.  That  is,  §  rj'(w)  =  B  ^  (z). 


Definition.  X  is  called  the  m-th  IBE£  of  ur0i,  m  =  L>2, , 


Lemma.  For  m  =  1,2,.., 


9 


Proof.  The  proof  is  straightforward  involving  just  the  routine  evaluation 

of  integrals  of  type 


f  _«l* 

“0 


aiz  r 

e  b^z  +  c-^dz  +  z  #(  a2z)<J>(bgz  +  Cg)dz. 


Theorem.  For  m  =  1,2,... 


*(m),  .  „  ,  ,  \Tf  m  ,  *(r ),  «. 

B  (»)  =  £  (-1)  v  ,  )C  IwJ  . 
r=0  r  x 

Proof.  From  Blumenthal  and  Cohen  (1968)  we  know  that  the  theorem  is  true 
for  m  =  1.  Suppose  it  is  true  for  m  =  k.  Then,  by  definition 


*(k*l)  *(k) 


k-1 


sr  ,  * 


Therefore, 


X"'*''*'  =  X  -  £  (-1)"  (*)C  '  '(Z). 

r=0  Tt'L 


<*>£  C*W(Z) 


r=0 


kr+lJ 


=  k£1(-i)r(r^1)c*(r)(w)  -  kz1(-Dr(^1)(c*(r+1)(u))  -  c*(0)un 


r=0 

k 


£  (-Dr(j;^  c#(r)(o»). 

r=0 


r=0 


Thus,  the  theorem  is  true  for  m  =  k+1.  The  proof  now  follows  by  induction. 


Corollary.  For  m  =  2,3,... 

x*(m)  =  x*(l)  .  z  (-l)r(  m  )c*(r^Z). 


r=0 


r+2 


A  numerical  study  as  to  the  behavior  of  B  1  (u»)  as  m  increases  shows  that 

^  ( rn  ^ 

for  smaller  values  of  0)  B  v"  '(«)  decreases  as  m  is  increased,  fne  behavior 
is  reversed  for  larger  values  of  m.  Table  h  gives  for  m  =  1,?, ...,30 


9 


b(m)  = 


I 

I 


*  1 


! 


r 

i. 


b(m)  =  max  |B  ^m^(v)| 

m  ~o.o(o. 1)5.0 

*(18) 

which  reveals  that  for  values  of  m  and  «g  considered  X  is  the  miniraax 

|bias |  IBEE. 

k.  Comparison  of  Estimators  of 

In  this  section  we  make  comparisons  between  the  "best"  estimators  of 
Blumenthal  and  Cohen  (1968),  the  "best"  MPE  and  the  "rainimax"  Ibias  |  IBEE 
as  regards  their  bias  and  MSE.  From  tables  and  graphs  of  Blumenthal  said 
Cohen  we  find  that  with  respect  to  the  bias  the  estimator 


(X1  +  X2)/2  if  z  <  t 


6h(D  - 


T2l 


if  Z  >  T 


seems  to  be  the  "best"  among  all  the  estimators  considered  and  with  respect  to 
MSE,  the  estimator 

ep  =  ^+a[l(z/^T)  .i]+i,42 

-F 

seems  to  have  an  advantage  over  the  other  estimators.  From  section  2  we  know 
that  among  the  nine  MPE's  considered  t„(0.5,0.5)  is  the  'best'  both  in  case  of 
bias  and  MSE.  In  Tables  5  and  6  we  give  the  bias  and  MSE  respectively  of  the 
four  estimators  ft„(l),  6_,  t_(0.5,0.5),  and  X  v  ;  and  compare  them  graphically 

n  r  d 

in  Figures  2  and  3.  (Note  that  the  MSE(X*^^)  was  calculated  using  Ntonte  Carlo 
techniques . ) 
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Table  3 :  MSE  of  Maximum  Probability  Estimators 
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Table  5:  Bias  Comparison 
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-O.O386 

0.0004 

1.9 

-0.0674 

0.0221 

-O.O3O6 

-0.0010 

2.0 

-O.O535 

0.0170 

-O.O238 

-0.0109 

2.1 

-0.0417 

0.0129 

-0.0181 

-0.0057 

2.2 

-O.O318 

0,0098 

-O.OI35 

-0.0026 

2.3 

-0.0238 

0.0073 

-0.0100 

-0.0228 

2.4 

-0.0175 

O.OO54 

-0.0071 

-0.0177 

2.5 

-0.0125 

0.0040 

-0.0050 

-0.0104 

2.6 

-0.0089 

0.0029 

-0.0035 

-0.0003 

2.7 

-0.0062 

0.0021 

-0.0024 

-0.0076 

2.8 

-0.0042 

0.0015 

-0.0016 

-0.C139 

2.9 

-0.0028 

0.0011 

-0.0011 

-0.0024 

3.0 

-0.0019 

0.000S 

-0.0007 

-0.0174 

4.0 

-0.0000 

0.0000 

-0.0000 

-0.0015 

5.0 

0.0000 

0.0000 

-0.0000 

0.0004 
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Table  6;  MSE  Comparison 


« 

yi) 

6 

P 

t2(0.5,0.5) 

X*(18) 

0.0 

0.7862 

1.2182 

0.8529 

3.0538 

0.1 

0.7633 

1.0455 

0.8109 

3.0^25 

0.2 

0.7729 

0.9067 

0.8014 

3.0582 

0.3 

0.8076 

0.7970 

0.8167 

2.9850 

0.4 

0.8609 

0.7113 

0.8495 

2.9157 

0.5 

0.9261 

0,6453 

0.8933 

2.7558 

0.6 

0.9974 

0.5989 

0.9425 

2.6158 

0.7 

1.0694 

0.5674 

0.9920 

2.4251 

0.8 

1.1375 

O.5520 

1.0382 

2.2187 

0.9 

1.1980 

0.5496 

1.0782 

2.0066 

1.0 

1.2479 

0.5590 

1.1102 

1.8548 

1.1 

1.2854 

0.5795 

1.1334 

1.7210 

1.2 

1.3098 

0.6070 

1.1478 

1.5996 

1.3 

1.3212 

0.6417 

1.1538 

1.4964 

1.4 

1.3205 

0.6794 

1.1526 

1.4021 

1.5 

1.3093 

0.7189 

1.1456 

1.2870 

1.6 

1.2897 

0.7583 

1.1342 

1.1914 

1.7 

1.2639 

0.7956 

1.1200 

1.1325 

1.8 

1.2342 

O.8305 

1.1044 

1.0869 

1.9 

1.2028 

O.86I5 

I.O885 

1.0673 

2.0 

1.1715 

0.8888 

1.0731 

1.0432 

2.1 

1.1417 

0.9120 

1.0590 

1.0229 

2.2 

1.1144 

0.9315 

1.0466 

1.0167 

2.3 

1.0904 

0.4474 

I.O36O 

I.OI36 

2.4 

1.0699 

0.9601 

1.0272 

1.01^9 

2.5 

1.0529 

0.9702 

1.0201 

1.0194 

2.6 

I.O391 

0.9780 

1.0146 

1.0207 

2.7 

1.0284 

0,9840 

1.0103 

1.0213 

2.8 

1.0202 

0.9885 

1.0072 

1.0206 

2.9 

1.0140 

0.9918 

1.0049 

I.OI85 

3.0 

I.OO96 

0.9942 

I.OO33 

I.OI55 

4.0 

1.0001 

0.9999 

1.0000 

0.9979 

5.0 

1.0000 

1.0000 

1.0000 

1.0024 
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Figure  1:  Graphical  investigation  of  behavior  of  MPE’s,  f,  the  density  of  V, 
a2>  the  adjustment  in  given  by  MPE  of  81,1(1  8  -  a^f  are 

plotted  against  Z.  For  all  (r^,r,,)  pairs  considered,  ' h) ,  (b),  (c 
represent  the  typical  plots  when  w  =  3*^,  -.0,  0.0  respectively. 
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